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(54) Image input apparatus 

(57) An image input apparatus has a photoelectric 
converter element having a flat photosensitive surface 
and an image formation unit array having a plurality of 
image formation units arranged in an array. This image 
formation units individually receive light beams substan- 



tially from an identical area and focus the received light 
beams on different regions of the photosensitive surface 
of the photoelectric converter element to form images 
thereon. 



FIG.1 
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Ascription 

I°001] This application is based on application No. H1 1-233760 filed in Japan on August 20, 1999, the entire con- 
tents of which are hereby incorporated by reference. 

BACKGROUND OF THE INVENTION 



fi eld of the Invention 

[0002] The present invention relates to an image input apparatus that forms an image through a plurality of minute- 
ir ^age-formation optical systems. 
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Bsscriptinn of the Prior Art 

15 [0003] In recent years, with the advent of highly information-oriented society brought by the development of com- 
munications media, there has been a keen demand for acquiring various kinds of information effectively and timely. 
Such information includes a very large proportion of image information, and therefore recording and saving of image 
information are essential for conducting advanced information processing activities. Conventionally, apparatuses such 
as photographic cameras and video cameras have been used for recording and saving image information. However, it 
's impossible to miniaturize beyond a certain limit such apparatuses by making their constituent components smaller, 
a nd therefore, to realize apparatuses so compact as to be portable all the time, it is necessary, and in fact expected, to 
develop a compact image input apparatus based on a novel construction. 

[0004] An arrangement conventionally known to help miniaturize an image input apparatus makes use of a lens 
a »Tay composed of a plurality of microlenses combined together. This is an application of the compound-eye seen in the 
v ^ual system of insects, and helps realize an optical system that occupies less volume, offers a wider angle of view, 
and is brighter than a "single-eye" image formation system. 

[0005] As a conventional image input apparatus adopting this arrangement, for example, Japanese Published Pat- 
ent Application No. S59-50042 discloses an image input apparatus composed of a microlens array, a pinhole array, and 
an image surface. Here, the microlenses form a reduced image of an object, and the pinholes, paired one to one with 
30 microlenses, sample different parts of this reduced image, forming together an image of the object on the image 

surface. 

[0006] As another example, Japanese Laid-Open Patent Application No. H5-100186 discloses an image input 
apparatus composed of a microlens array, a pinhole array, and a photosensitive element array. Here, the microlenses, 
Pinholes, and photosensitive elements are grouped into units each composed of a microlens, a pinhole, and a photo- 
sensitive element, and the individual units convert optical signals received from different parts of an object (subject) into 
e| ectric signals, that together represent image information. 

[0007] As still another example, Japanese Laid-Open Patent Application No. H1 0-1 07975 discloses an image input 
apparatus in which a plurality of photosensitive elements are arranged for each of microlenses. Here, the image of an 
object formed by the microlenses is not sampled by pinholes that individually sample different parts thereof, but is 
40 directly read by a two-dimensionally extending photosensitive element array that yields signals of minute images. Here, 
an aperture stop is arranged on the object side of the photosensitive element array and the microlens array, and the 
^dividual microlenses observe different parts of the object with no overlap among the signals obtained. 
t0008] However, the image input apparatuses disclosed in Japanese Published Patent Application No. S59-50042 
and Japanese Laid-Open Patent Application No. H5-100186 mentioned above both have basically the same optical 
system, and suffer from unsatisfactory resolution in the image signals obtained. Specifically, in a lens-pinhole type com- 
Pound-eye optical system, the number of units each including a microlens and a photosensitive element coincides with 
*e number of dots, i.e. resolution, of the obtained image, therefore it is inevitable to increase the number of units to 
°btain a high-resolution image. However, even a microlens needs to have a certain size to function satisfactorily as a 
le ns, and therefore, in this compound-eye optical system, it is impossible to increase beyond a certain limit the number 
S ° °f units even if the microlens are arranged in a closest packed structure. As a result, it is difficult to obtain a high-reso- 
image. 

[0009] On the other hand, the arrangement disclosed in Japanese Laid-Open Patent Application No. H10-107975 
Mentioned above solves the problem of unsatisfactory resolution in the image signals obtained, but, to obtain the best 
°Ptical characteristics in this optical system, it is necessary to arrange the microlens array and the photosensitive ele- 
ment array on a spherical surface having its center at the aperture stop, and thus this arrangement is not fit for the pur- 
Pose of making the entire image input apparatus satisfactorily compact. In particular, the individual photosensitive 
dements need to be arranged at discrete locations on a curved surface, i.e. a spherical surface in this case. This makes 
th *e photosensitive elements difficult to arrange in desired positions, and thus makes the entire image input apparatus 



ss 



2 



EP 1 079 613 A2 



difficult to manufacture. 

[001 01 In another invention, no aperture stop is used, and a microlens array and a photosensitive element array are 
each arranged on a flat plane. However, here, to prevent interference between the optical signals from adjacent micro- 
lenses, the photosensitive element array needs to be arranged at a certain distance from the microlens array, and thus 
the photosensitive element array requires an unduly large fitting area. In addition, this arrangement is speaa .zed for 
narrow object angles at the cost of optical characteristics, and therefore exhibits various drawbacks in practical use. 



SUMMARY OF THE INVENTION 



10 [001 1] An object of the present invention is to provide an image input apparatus that has a simple construction, that 
is more compact than ever, and that offers high-resolution images. 

[0012] To achieve the above object, according to the present invention, an image input apparatus is provided w.m: 
a photoelectric converter element having a flat photosensitive surface; and an image formation unit array having a plu- 
rality of image formation units arranged in an array. Here, the plurality of image formation units individually receive light 
,s beams substantially from an identical area and focus the received light beams on different regions of the photosensitive 
surface of the photoelectric converter element to form images thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 [001 3] This and other objects and features of this invention will become clear from the following description, taken 
in conjunction with the preferred embodiments with reference to the accompanied drawings in which: 

Fig 1 is an exploded perspective view schematically showing an image input apparatus embodying the invention; 
Fig. 2 is a vertical sectional view schematically showing the optical systems of two adjacent units in an image input 
25 apparatus embodying the invention; 

Figs. 3A to 3D are perspective views schematically showing the manufacturing process of diffractive optical lenses. 
Figs. 4A to 4D are diagrams schematically showing the manufacturing process of refractive lenses; 
Fig 5 is a diagram showing the multiple reduced images formed by the lens array; 

Fig. 6 is a diagram showing an image reconstructed by gathering the signals obtained from the pixels at the center 

Fig 7 "sadiagram showing an image reconstructed by using the signals obtained from all the photosensitive ele- 
ments; 

Fig 8 is a perspective view schematically showing a signal separation polarizing filter; 

Figs. 9A and 9B are perspective views schematically showing the configuration of the signal processing system for 

35 processing optical signals; 

Fig. 10 is a diagram schematically illustrating the relationship between the photosensitive area and the minute view 

Fig. 11 is a diagram schematically showing the relationship between the object and the view angle of the image 

input apparatus; . . 

40 Figs. 12A and 12B are diagrams schematically showing the principle of making the view angle of the image input 

apparatus wider; . 
Fig. 13 is a diagram schematically illustrating deflection caused by decentering of the image formation elements; 
Fig 14 is a diagram schematically illustrating deflection caused by a diffraction grating; and 
Fig. 15 is a perspective view schematically showing the construction of an image input apparatus employing dis- 

4S persive elements. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0014] Hereinafter, embodiments of the present invention will be described with reference to the drawings. This 
50 invention provides a slim type image input apparatus in which a single plane photosensitive element array ,s divided into 
areas each corresponding to one microlens so that each area includes a plurality of photosensitive elements and in 
addition partition walls are provided to prevent interference among the optical signals from the individual m.crolenses. 
Fig 1 is an exploded perspective view schematically showing an image input apparatus embodying the invention. 
[001 5] In Fig 1 reference numeral 1 represents a microlens array having microlenses 1a arranged in a two-dimen- 
55 sional array, in a square shape for example, and reference numeral 3 represents a photosensitive element array dis- 
posed below the microlens array 1 so as to face it and having photosensitive elements 3a arranged similarly in a two- 
dimensional array, in a square shape for example. Reference numeral 2 represents a partition wall layer d.sposed 
between microlens array 1 and photosensitive element array 3 and composed of partition walls 2a that are arranged 
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below the boundaries of the individual microlenses 1a of the microlens array 1 so as to form a grid-like structure. 
[001 6] As shown in Fig. 1, one microlens 1a of the microlens array 1 corresponds to a plurality of photosensitive 
e 'ernents 3a of the photosensitive element array 3, and corresponds to one compartment formed in between in the par- 
tition wall layer 2. As an imaginary square prism drawn with broken lines indicates, these together form a signal 

5 Processing unit U. The individual units are separated from one another by the partition walls 2a to prevent the optical 
si 9nal from one microlens 1a from entering the adjacent units; that is, the optical path through each unit is restricted. 
As the photosensitive element array 3, it is possible to use a solid-state image-sensing device such as a CCD. This 
helps reduce the number of components needed and thereby simplify the construction of the image input apparatus. 
[0017] Fig. 2 is a vertical sectional view schematically showing the optical systems of two adjacent ones among 

10 those units. In this figure, when an image of an object (not shown) located above the apparatus is focused within the 
target unit U1, the light beam L1 coming from the object as a rightful optical signal strikes the microlens 1a belonging 
to the unit U1 by traveling parallel to the optical axis X1 thereof. Then, the light beam is condensed by that microlens 
1a on the photosensitive element array 3 belonging to the unit U1. At this time, if a light beam L2, as an unnecessary 
°Ptical signal, enters the adjacent unit U2 by traveling obliquely from a direction opposite to the target unit U1 at a large 

15 angle relative to the optical axis X2 of the microlens 1a belonging to the unit U2, this unnecessary light beam L2 also 
,s focused on the photosensitive element array 3 belonging to the target unit U1 . 

[0018] It is for the purpose of preventing such interference that the partition walls 2a, as shown in Fig. 2, are pro- 
vided between the units. It is needles to say that interference is perfectly prevented if the partition walls are formed so 
as to extend from the microlenses 1a to the photosensitive element array 3. However, even if the partition walls are 
20 formed partially, they effectively reduce unnecessary signals. When the partition walls 2 are formed so as to extend ver- 
tically from the microlenses 1 downward, as shown in Fig. 2, for each unit, the following formula (1) holds: 

x=(a-c)d/2c (1 ) 

25 where 

x represents the width of the area struck by an optical signal coming from an adjacent unit and having half the 
amount of light per microlens; 

30 a represents the distance between the microlens and the photosensitive element; 

c represents the height of the partition walls; 

d represents the width of the unit. 

35 

[O019] In this case, it is not possible to perfectly prevent interference; however, the higher the partition walls are 
made, the less interference occurs. How much the interference among signals affects the image information eventually 
OD tained can be evaluated practically by simulation or the like. 

[°020] Regarding the microlens array mentioned above, the sizes of the whole microlens array and of each unit, the 
40 number of microlenses, the focal length, the manufacturing process will be presented below. Here, two types of micro- 
tens array, one using diffractive optical lenses and the other using refractive lenses, are presented. Moreover, as the 
type using diffractive optical lenses, two examples of different sizes are presented. 



45 Table 1 



([Diffractive Optical Lens Type)) 


Unit pitch 


176 u,m 


250 n.m 


Overall size 


8.8mm x 6.7mm (50 x 38 units) 


15mm x 15mm (60 x60 units) 


Focal length 


176 ujti 


250 u,m 



* Manufacturing Process 

[0021] The manufacturing process of diffraction optical lenses is shown in Figs. 3A to 3D. First, as shown in Fig. 3A, 
a resist R is applied to the surface of a glass substrate G. As this resist R, an electron resist is used. Next, as shown in 
Fi 9. 3B, by using an electron beam drawing machine, the desired pattern Pn is drawn on the resist R. Then, as shown 
in Pig. 3C, the drawn pattern is developed. Finally, as shown in Fig. 3D, the drawn and developed pattern is transferred 
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onto the glass substrate G by using an etching machine. 

[0022] The drawn pattern consists of Fresnel zone plates of either a binary or a multilevel type. Prototype lens 
arrays currently being manufactured have a minimum line width of 0.4 urn with binary-type zone plates and 0.2 urn with 
multilevel-type zone plates. When the minimum line width is as wide as about 1 urn, a laser beam can be used to draw 
5 the pattern. 



Table 2 



(Refractive Lens Type)) 


Unit pitch 


176 um 


250 um 


Overall size 


8.8mm x 6.7mm (50 x 38 units) 


15mm x 15mm (60 x 60 units) 


Focal length 


about 230 urn 


about 350 um 



15 

• Manufacturing Process 

[0023] Figs. 4A to 4D show the manufacturing process of refractive lenses. A so-called thermal re-flow method is 
applied here. First, as shown in Fig. 4A, a glass substrate G having a photo resist PR applied to its surface is coated 

20 with a mask M having a pattern drawn thereon. Then, the glass substrate G is exposed to light from above as indicated 
by arrows W. The pattern is thus transferred onto the photo resist PR by so-called photolithography. Here, unlike diffrac- 
tive optical lenses, the pattern consists not of Fresnel zone plates but of an array of circles that is used as a mask. 
[0024] After exposure and then development, as shown in Fig. 4B, the resist remains as a pattern of cylindrical 
patches. As shown in Fig. 4C, when these remaining resist patches are post-baked by using a hotplate or an oven, they 

25 melt and form into the shapes of lenses by their own surface tension. As shown in Fig. 4D, by etching these resist 
patches, the resist patter is transferred onto the glass substrate G. Quartz is the typical material of the glass substrate 
G. The thermal re-flow method mentioned above is described in: "Micro-optics" by Hans Peter Herzig, p132-p136, pub- 
lished 1997 by Taylor & Francis. 

[0025] The partition walls mentioned above need to meet the following requirements: 

30 

1 . The partition walls should be as thin as possible. 

2. The partition walls should preferably extend from the microlenses to the photosensitive element surface. 

3. The partition walls should be opaque and should reflect or scatter as little light as possible. 

35 [0026] In practice, the partition walls are produced, for example, by cutting a metal with a laser, or by three-dimen- 
sionally molding a photo-setting resin. As an example produced by cutting a metal with a laser, prototype partition walls 
having a thickness of 20 um and arranged at intervals of 250 um are produced from a stainless steel plate having a 
thickness of 200 um. Here, to prevent reflection, the surfaces of the partition walls are blackened. 
[0027] As an example produced by three-dimensionally molding a photo-setting resin, prototype partition walls are 

40 produced by scanning with a laser beam a resin called pentaerythritol triacrilate (PETA), which has a highly self-focus- 
ing property against light entering it, with 3% of benzil added thereto as a photopolymerization starter. It is confirmed 
that the partition walls thus produced have a thickness of about 56 um and a height of about 500 um. 
[0028] How, the image obtained by using the image input apparatus of this embodiment will be described. Fig. 5 is 
a diagram of multiple reduced images formed by the lens array. The lens array used here is an array of gradient-index 

45 plane microlenses produced by ion exchange that have a focal length of 650 um, have an aperture diameter of 250 urn, 
and are arranged at intervals of 250 um. The photosensitive element used here is a CCD image-sensing device with 
739 x 575 elements each having an aperture of 1 1 \im x 1 1 um. In this case, approximately 22.7 x 22.7 elements con- 
stitute one unit. Although the number of elements that constitute one unit is not an integer number here, this does not 
affect the final image. 

so [0029] Fig. 6 is a diagram showing an image reconstructed by gathering the signals obtained from the pixels at the 
centers of the units. As shown in this figure, an erect image of the object is obtained. Fig. 7 is a diagram showing an 
image reconstructed by using the signals obtained from all the photosensitive elements by an inverse matrix method. 
As shown in this figure, a satisfactory image is obtained. 

[0030] Separation of adjacent signals as described above can also be achieved with a combination of polarizing HI- 
55 ters, instead of using partition walls as described above. Fig. 8 is a perspective view schematically showing such polar- 
izing filters. As shown in this figure, this polarizing filter array 4 is divided into blocks 4a each corresponding to one unit 
described above and has polarized light transmitting filters arranged in a checkered pattern such that every two adja- 
cent filters have mutually perpendicular polarization directions. Two such polarizing filter arrays are prepared and 
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arranged one at the microlens array surface and the other at the photosensitive element surface shown in Fig. 1 with 
each polarizing filter aligned with the corresponding unit. 

[0031] Here, with respect to a given unit, the filter blocks 4a adjacent thereto upward, downward, leftward, and right- 
ward transmit only light polarized perpendicularly to the polarization direction of the filter block of the given unit. Thus, 
5 interference among the optical signals entering these adjacent units is prevented. By selectively using the signals 
obtained through units of a particular polarization direction, it is possible to realize an image input apparatus that exhib- 
its different sensitivities in different polarization direction. 

[0032] As those polarizing filters, either diffractive optical elements or hybrid elements, i.e. diffractive optical ele- 
ments and refractive optical elements combined together, are used. The polarizing filters, when composed of diffractive 

10 optical elements, is produced in the same manner as the diffractive lens array described above. That is, a resist pattern 
drawn by using an electric beam drawing machine is transferred onto a glass substrate by etching. Here, the pattern of 
the polarizing filters is basically of a binary type consisting of lines and spaces. A minimum line width of approximately 
0.2 uxri can be obtained by using currently available electric beam drawing machine. Like the microlens array, when a 
relatively large minimum line width suffices, a laser beam drawing machine can be used. 

15 [0033] Now, how this image input apparatus is used when it is used as an image input apparatus that exhibits dif- 
ferent sensitivities in different polarization directions will be described. In general, on the basis of polarization informa- 
tion of an object, it is possible to know physical properties, such as the dielectric constant, of the object. To conduct 
measurement with a high sensitivity, accurate alignment and the like are necessary. However, even with a compara- 
tively simple image input apparatus, it is possible to obtain general information regarding physical properties of an 

20 object. For example, when reflection occurs on the surface of a dielectric substance, it exhibits varying reflectances 
toward differently polarized light components. Thus, by observing polarization information, it is possible to know the 
angle of the reflecting surface relative to the image input apparatus. 

[0034] For example, this technique can be applied in a measuring instrument for measuring the angle of a reflecting 
surface such as a glass plate. As other examples, this technique can be applied to measurement of stress distribution 
25 inside a transparent object such as a plastic plane, or in an image input apparatus, such as a polarizing filter used in a 
camera, which acquires an object image by separating images reflected from and transmitted through a glass plate. 
[0035] The total thickness of an image input apparatus embodying the present invention depends on the following 
parameters: 

(Thickness of the Glass Substrate) + (Focal Length of the Microlenses) + 

(Thickness of the Photosensitive Elements) 

[0036] Figs. 9A and 9B are perspective views schematically showing the configuration of the signal processing sys- 
tem for processing the optical signals acquired by an image input apparatus of the invention. As shown in Fig. 9A, 
assume that the distance between the object 5 and the microlens array 1 is A, the distance between the microlens array 

35 1 and the photosensitive element array 3 is B, and the intervals at which the individual units are arranged is D. Refer- 
ence symbol O represents the output signals obtained from the photosensitive element array 3. Moreover, suppose that 
the numbers of the column and row in which a unit of the image input apparatus lies are represented by p and q, and 
that, as shown in Fig. 9B, the minute image in the unit [p, q] (i.e. the input signal entering the unit) is expressed as I p q (x, 
y) and the choice function of the input signals is expressed as f p , q (x, y), then the output signal O p q is given by formula 

™ (2) below. 



° P ,q = 1 Pl q ( x - y) f P ,q( x <y) dxd y ( 2 ) 

[0037] In Fig. 9A, in individual regions E on the photosensitive element array 3 (photoelectric converter element), 
45 images of the area (object 5) are formed as object images 5a seen from different view points. The images obtained in 
the individual units are object images 5a shifted by a predetermined distance from one another on the photosensitive 
element array 3 in accordance with the arrangement of the object 5, the microlens array 1 , and the photosensitive ele- 
ment array 3. For simplicity's sake, assume that the microlens array 1 exerts no deflecting effect. Then the relative shift 
amount A in each unit is given by formula (3) below. 

50 

A=BD/A (3) 



Accordingly, using the input signal l 0t o (x, y) of the unit [0, 0], the output signal of each unit is given by formula (4) below. 

° Pl q = W 1 o,o ( x -p a > y-q*) f p,q( x * y) dxd y ( 4 ) 

[0038] Here, by manipulating the choice function f p q (x, y) of each unit, it is possible to obtain various effects. For 
example, when only the signal at the unit origin is chosen, then f p q (x, y) = 8 (x, y), and hence the output signal is given 
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by formula (5) below. 

°p,q =l 0 ) 0(-P A '-q A ) & 

5 This formula presents the image obtained by enlarging I 0( o( x . y) bv a factor of A/BD. Since l 0 0 (x, y) represents an 
inverted image of the object enlarged by a factor of A/B, the aggregate of the output signals from the individual units O 
p q is equivalent to an erect image of the object enlarged by a factor of 1/D. 

[0039] Now, as another case, assume that formula (6) below is used as the unit choice function. 
10 f p , q (x,y)=5(x-ap,y-Pq) (6) 

In this case, formula (2) above yields formula (7) below. 

O =l 00 {-p(A-a),-q(A-P)} ( 7 > 

75 

This formula indicates that an image of the object enlarged by a factor a/ (a-cc)D in the x direction and by a factor of 
a/(a-P)D in the y direction is obtained. 

[0040] Now, as still another case, assume that formula (8) below is used as the unit choice function. 
20 f pq (x, y) = 5 {x-(P-p)A(cos9-1)-(Q-q)Asin9, y+(P-p)Asin9-(Q-q)A(cos9-1)} (8) 

In this case, the output signal is given by formula (9) below. 

O n =l po { (P-P)A cos 9 + (Q-q)A sin 6, -(P-p)A sin 9 +(Q-q)A(cos 9} (9) 

2S P,q ' 

This formula represents an image equivalent to an image of the object rotated through 9 degrees counter-clockwise 
about the unit [P, Q]. 

[0041] Now, as a further case, assume that formula (10) below is used as the unit choice function. 
30 f p , q (x,y) = S(x)rect(y/1 y ) (10) 

In this case, when input signals spreading in the y direction are chosen, the output signal is given by formula (1 1 ) below. 

° P ,q = s 1y/2 -iy/2 1 o,o y-q*) d y < 1 1 > 

3$ 

This response characteristic can be used to extract the information of a line segment extending in the y direction. 
[0042] As described above, by varying the definition of the unit choice function f p q (x, y), the obtained image sig- 
nals can be processed in various ways. In an image input apparatus of the present invention, this can be achieved by 
specifying the addresses of the signals read out from the photosensitive element array. In other words, by calculating, 

40 using the signals from the photosensitive elements at the addresses corresponding to the choice function used, the out- 
put signals of the units they belong to, it is possible to obtain output signals corresponding to formula (2). 
[0043] Note that, in an image input apparatus of the present invention, even if the constituent components are 
aligned insufficiently with one another in assembly, it is possible to obtain correct signals by processing the signals in 
an appropriate manner. Specifically, the procedure for achieving this is as follows. First, the partition walls are aligned 

45 with and then bonded to the microlens array, then the thus obtained integral unit is arranged in close contact with the 
surface of the photosensitive element array. In this state, the apparatus is already ready for use, but, to achieve more 
efficient use of the photosensitive element array and to facilitate post-processing, the above-mentioned integral unit is 
aligned with the photosensitive element array such that the partitions of the former are parallel with the regions of the 
latter. 

5o [0044] This is achieved by observing the moire fringes that are formed by the shadow of the partition walls and the 
photosensitive regions when light is shone into the apparatus. In this adjustment procedure, the pixels that output 
bright-state signals are regarded as effective pixels from which to read actual optical signals, and therefore, by using 
the positions of these pixels, it is possible to know the correspondence between the signals of the individual units and 
the addresses at which to read the outputs of the photosensitive elements. For example, unnecessary signals can be 

55 easily excluded by masking the other signals than those of the effective pixels after acquiring the data from all pixels. 
[0045] Incidentally, l p q corresponds to the signal obtained from the photosensitive elements of the unit [p, q]. Thus, 
when the partition walls reach the photosensitive element surface, I p q represents the signals from the photosensitive 
elements except those located at the partition walls. When the partition walls do not reach the photosensitive element 
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10 



15 



20 



25 



StJ rface. | p q represents the signals from the photosensitive elements excluding the photosensitive regions where inter- 
ference is occurring. 

[0046] in an actual image input apparatus, f p q has finite sampling range and thus is a "reef function, i.e. a function 
that gives "1" within the range corresponding to the regions (minute view angles) participating in image sensing and that 
gives "0" outside that range. In Fig. 10, the relationship between the width T| of a pixel that senses light on the photo- 
sensitive element surface S and minute view angle p is given by formula (c) below. 

p=2tan" 1 (Ti/2f) (c) 

where f represents the focal length of an image formation element IF. The range of the rect function is determined by 
using this formula. 

[0047] Fig. 1 1 is a diagram schematically showing the relationship between the object and the field of view of the 
image input apparatus. This figure shows a case in which an image of an object 5 occupying an area extending over a 
,e ngth of X is formed on the photosensitive element array 3 through the microlenses L j( j. Inverted, reduced images of 
the entire object 5 are formed through the individual microlenses of the microlens array 1 on the corresponding regions 
°f the photosensitive element array 3. Here, since the individual lenses of the microlens array 1 have different positional 
relationships with the object 5, the images formed on the individual regions of the photosensitive element array 3 have 
different information from one another. This is exploited to reconstruct an image. 

[0048] Specifically, an image X of the entire object 5 is focused through each microlens L jtj of the microlens array 
1 . so as to form an image Z ( L { j ) on the corresponding region of the photosensitive element array 3. In other words, 
the same number of inverted, reversed images of the object surface 5b on the object 5 as that of microlenses in the 
Microlens array 1 are formed on the image formation surface 3b of photosensitive element array 3. Here, since the indi- 
vj dual regions of the photosensitive element array corresponding one to one to the individual lenses have different posi- 
tional relationships with the object 5, the images formed on the individual regions have different information as to the 
Position of the image within the region, the intensity of the signal, and the like. This is exploited, for details, refer to the 
descriptions of Fig. 9A and Fig. 9B above. 

[0049] Figs. 1 2A and 1 2B are diagrams schematically showing the principle of making the field of view of the image 
input apparatus wider. As shown in Fig. 12A, each microlens L | j of the microlens array 1 images a length of X y on the 
°oject plane 5b on the object 5 onto the image formation surface 3b of the photosensitive element array 3. Since the 
individual microlenses L j j are located at different locations, they form images of different areas on the object surface 
5b. 

As shown in Fig. 12 B, such differences are increased by the use of deflecting member, which thus helps make the 
° v erall field of view wider. 

[0050] Thus, when shooting needs to be performed with a wider view angle instead of the microlens array 1, for 
Sample,, a lens array 6 with a deflection function, i.e. a functional optical element having both deflecting and image- 
forming functions is used. This lens array 6 has deflecting elements 6a provided one for each unit Thus, the fields of 
v iew V of the individual units combine to cover a wider area on the object 5. 

[0051] Deflecting elements having such a deflecting function can be realized not only with prisms but also with dif- 
fracting optical elements. Their material, manufacturing process, size, and others are common to the diffractive lenses 
described earlier. Specifically, one method is to decenter the center of a pattern, such as Fresnel zone plate, that has 
an image-formation function in the direction in which to diffract the incident light. Another method is to overlay a one- 
dimensioned diffraction grating on an image-forming diffractive optical element. Both methods produce the same 
e ffects. When the deflection angle is relatively narrow, the former method is recommendable and when the deflection 
ar »gie is relatively wide, the latter method is recommendable. How the field of view varies as a result of introduction of 
deflecting elements can be controlled by manipulating the parameters of each deflecting element. 
[0052] Fig. 13 is a diagram schematically illustrating an example of the construction based on the former method 
described above. In this diagram, £ represents the amount of decentering of the Fresnel zone plate F, a represents the 
vj ew angle, and f represents the focal length. Fig. 14 is a diagram schematically illustrating an example of the construc- 
tion based on the latter method described above. In this diagram, d represents the grating constant of the one-dimen- 
sioned diffraction grating DG, a represents the view angle, and X represents the wave length of the incident light. In both 
diagrams, \^ represents the incident light and l 2 represents the diffracted light. Here, the decentering amount £ and the 
9 r ating constant d function as the above-mentioned parameters of each deflecting elements. The view angle a that 
e ach unit offers is equal to the deflection angle through which the incident light is deflected. Thus, Figs. 13 and 14 give 
formulae (a) and (b) below. 

55 a=tan' 1 (5/f) (a) 

a = sin " 1 (m X/d) (b) 



30 



35 



40 



45 



SO 



8 



EP1 079 613 A2 

where m represents an integer number. When a diffraction grating is used f a large number, corresponding to m, of kinds 
of diffracted light appear. However, for example by giving the diffraction grating blaze-shaped grooves, it is possible to 
obtain only one kind of diffracted light. 

[0053] Fig. 15 is a perspective view schematically showing the construction of an image input apparatus employing 
5 a functional optical element to which a dispersive property is added. As shown in this diagram, which shows only a por- 
tion corresponding to one unit, as a functional optical element, a diffraction grating 7 is arranged above a photosensitive 
element array 3 so as to face it. Independent spectroscopes are formed one for each unit, so that the spectral data of 
different parts of the sensed object can be obtained. This diffraction grating 7, having different grating constants in the 
x and y directions indicated by arrows in the diagram, deflects the incoming light L at different angles according to the 
10 wave length, and then leads the resulting optical signal as spectral light La to the photosensitive elements 3a located 
at different locations on of the photosensitive element array 3. 

[0054] Here, it is not necessary to provide a special filter for selecting particular wave lengths on the side of the pho- 
tosensitive element array 3, and therefor a so-called single plane photosensitive element can be used as it is. The pho- 
tosensitive elements 3a constituting each unit are arranged in a square shape, and by deflecting the optical signals of 
15 the spectral light La in such a way as to cover all the area of that square, it is possible to make efficient use of the pho- 
tosensitive elements 3a. 

[0055] The spectroscopes mentioned above are manufactured as diffractive optical elements just like the polarizing 
filters and deflecting elements described earlier. Therefore, they are produced from a quartz glass substrate by a similar 
manufacturing process. The pattern formed here is designed to have different predetermined grating constants in the x 
20 and y directions so that incident light is deflected at varying angles according to the wave length independently in each 
direction. 

[0056] Images obtained as a set of spectral data in this way have the following advantages and uses. Generally, an 
object is observed through a primary color filter when it is handed as visual information; however, more versatile infor- 
mation of the object can be obtained by using its spectral data. For example, different materials have different spectral 
25 absorption coefficients, and therefore it is possible to identify the materials constituting the object and investigate their 
distribution by measuring the spectrum absorbed by the object. Furthermore, this technique can be applied to an appa- 
ratus which checks the level of comfortableness, mental state, and the like of a subject person by measuring the per- 
son's perspiration by using the wave length information of the light absorbed by water. For details, refer to Japanese 
Laid-Open Patent Application No. H8-1 84555. 

30 

Claims 

1. An image input apparatus comprising: 

35 a photoelectric converter element having a flat photosensitive surface; and 

an image formation unit array having a plurality of image formation units arranged in an array, 
wherein the plurality of image formation units individually receive light beams substantially from an identical 
area and focus the received light beam on different regions of the photosensitive surface of the photoelectric 
converter element to form images thereon. 

40 

2. An image input apparatus as claimed in claim 1, 

wherein the individual images formed on the different regions are images of an object lying in the area as seen from 
different view points. 

45 3. An image input apparatus as claimed in claim 1, further comprising: 

a restricting member for restricting, independently for each of the plurality of image formation units, optical 
paths along which the light beams are focussed. 

50 4. An image input apparatus as claimed in claim 3, 

wherein the restriction member is realized as partition walls. 

5. An image input apparatus as claimed in claim 4, 

wherein those pixels of the photoelectric converter element which output a bright-state signal when light enters the 
55 plurality of image formation units are regarded as effective pixels. 

6. An image input apparatus as claimed in claim 3, 

wherein the restricting member is a polarizing filter array having polarizing filters arranged one for each group of 
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the plurality of image formation units, every two adjacent polarizing filters having mutually perpendicular polariza- 
tion angles. 

An image input apparatus as claimed in claim 1, further comprising: 

deflecting members provided one for each of the plurality of image formation units. 

An image input apparatus as claimed in claim 1, further comprising: 

spectroscopic members provided one for each of the plurality of image formation units. 

An image input apparatus as claimed in claim 1, further comprising: 

a signal processing system for processing signals obtained as a result of photoelectric conversion performed 
by the photoelectric converter element by using processing functions provided one for each of the plurality of 
image formation units. 
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FIG.12A 
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